Information Perspective of Optimization
نویسندگان
چکیده
In this paper we relate information theory and Kolmogorov Complexity (KC) to optimization in the black box scenario. We define the set of all possible decisions an algorithm might make during a run, we associate a function with a probability distribution over this set and define accordingly its entropy. We show that the expected KC of the set (rather than the function) is a better measure of problem difficulty. We analyze the effect of the entropy on the expected KC. Finally, we show, for a restricted scenario, that any permutation closure of a single function, the finest level of granularity for which a No Free Lunch Theorem can hold [7], can be associated with a particular value of entropy. This implies bounds on the expected performance of an algorithm on members of that closure.
منابع مشابه
Content Analysis of the High School Textbooks in Iran from Information Literacy Perspective
Content Analysis of the High School Textbooks in Iran from Information Literacy Perspective E. Ebraahimi Dorcheh M. Cheshmeh Sohraabi, Ph.D. M. R. Neyestaani, Ph.D. To determine the extent to which information literacy is utilized within the 10th grade textbooks across different disciplines, a sample of 19 textbooks from among 96 high school textbooks was selected. The instr...
متن کاملFunctional Requirements of the Pharmacy Information Systems from the Pharmacists' Perspective: A Qualitative Approach
Introduction: In the field of studying information systems, qualitative approach is one of the ways to extract the system requirements from the perspective of the users. Therefore, this study was performed to identify the functional requirements of the pharmacy information system from the perspective of the pharmacists using a qualitative approach. Method: This qualitative study was performed u...
متن کاملFunctional Requirements of the Pharmacy Information Systems from the Pharmacists' Perspective: A Qualitative Approach
Introduction: In the field of studying information systems, qualitative approach is one of the ways to extract the system requirements from the perspective of the users. Therefore, this study was performed to identify the functional requirements of the pharmacy information system from the perspective of the pharmacists using a qualitative approach. Method: This qualitative study was performed u...
متن کاملEvaluation of Hospital Information Systems Data Quality in Educational Hospitals of Zahedan University of Medical Sciences form Users’ Perspective
متن کامل
Research of Blind Signals Separation with Genetic Algorithm and Particle Swarm Optimization Based on Mutual Information
Blind source separation technique separates mixed signals blindly without any information on the mixing system. In this paper, we have used two evolutionary algorithms, namely, genetic algorithm and particle swarm optimization for blind source separation. In these techniques a novel fitness function that is based on the mutual information and high order statistics is proposed. In order to evalu...
متن کاملOptimization strategies for presenting a Narrative Medicine Course from the perspective of medical interns: a qualitative study
Introduction and Aim: Narrative medicine was introduced in 2000 as an approach to effective practice and humanism in medicine. A narrative approach was presented as a training course in order to improve the professionalism of medical interns in Isfahan University of Medical Sciences. The aim of this study was to describe the optimization strategies for presenting a narrative medicine educationa...
متن کامل